I am a computer vision researcher. Most of my explorations draws inspiration from the ingenuity of human brain. Its ability to improve itself with experiences, and its natural instinct to be creative guides my research in multi-modal learning and generative modeling with neural networks. I obtained my PhD and Master’s degree from IIT Hyderabad under the guidance of Prof. Vineeth N Balasubramanian.
June 25, 2025
Jialu's paper on inserting humans into scenes is accepted to ICCV 2025!
Dec 14, 2024
Humbled to receive IUPRAI Doctoral Dissertation Award. All credits to my advisor, friends and my family!
Aug 30, 2024
Design-o-meter, an approach to evaluate and refine design documents is accepted to WACV 2025 (round 1, acceptance rate 12.1%). Kudos to my brilliant undergraduate interns: Sahil Goyal (IIT Roorkee) and Abhinav Mahajan (IIIT Bangalore).
Jul 1, 2024
Prachi’s work on continual gesture recoginition is accepted to ECCV 2024 as an oral paper!
Feb 27, 2024
MeLFusion is accepted to CVPR 2024 as a highlight poster (11.9% acceptance rate)! Joint work with my first batch of interns at Adobe: Sanjoy (UMD) and Sayan (U of T).
Feb 3, 2024
Excited to be a participant at the inaugural edition of ACM India’s PIC!
Jan 6, 2024
Runner-up at ACM IKDD Doctoral Dissertation Award 2024!
Dec 9, 2023
Our work on contextualized prompt learning is accepted to AAAI 2024 as an oral paper.
Oct 24, 2023
Our work at Adobe on using diffusion models for iterative image editing is accepted to WACV 2024.
Jul 14, 2023
Two papers accepted to ICCV 2023. Thanks to my brilliant collaborators at Adobe Research and CMU.
Nov 14, 2022
Joined Adobe Research as a Research Scientist.
Jul 9, 2022
Two papers accepted to ECCV 2022.
Jun 21, 2022
Won AI-GameChangers award in the Deep Learning Algorithms category. Thank you, NASSCOM!
Jun 20, 2022
Our work on class discovery won the Best Paper Runner-Up Award at CLVision workshop, CVPR 2022.
Apr 15, 2022
Accepted to Doctoral Consortium at CVPR 2022, mentored by Prof. Trevor Darrell.
Apr 7, 2022
Humbled to recieve Excellence in Research Award from IIT Hyderabad second time!
Mar 2, 2022
Two papers accepted at CVPR 2022.
Oct 11, 2021
Our work on Incremental Object Detection is accepted to TPAMI (Impact Factor: 16.39).
Aug 8, 2021
Continuing at Google as a Student Researcher.
Apr 5, 2021
Joined Google Research as an Intern.
Mar 1, 2021
Our work on Open World Object Detection, is accepted at CVPR 2021 for oral presentation.
Sep 25, 2020
Our work on using Meta-Consolidation for Continual Learning is accepted at NeurIPS 2020.
Aug 30, 2020
Humbled to recieve Excellence in Research Award from IIT Hyderabad.
Jul 30, 2020
Our work on Zero-shot Domain Generalization is accepted at BMVC 2020.
Nov 24, 2019
Joined IIAI / MBZUAI, Abu Dhabi as a Research Intern.
Aug 8, 2019
Awarded TCS PhD Fellowship!
May 21, 2019
Our work on using submodular optimization is accepted at Negative Dependence workshop, ICML 2019.
May 21, 2019
Humbled to receive Travel Grants from Microsoft Research and ACM-India / IARCS to attend IJCAI.
May 10, 2019
Our work titled ‘Submodular Batch Selection for Training Deep Neural Networks’ is accepted at IJCAI 2019.
Apr 16, 2019
Would be attending International Computer Vision Summer School, ICVSS 2019 in Sicily, Italy.
Mar 14, 2019
Awarded ‘Certificate of Appreciation in Research’ from IIT Hyderabad.
Aug 31, 2018
Our paper titled ‘C4Synth: Cross-Caption Cycle-Consistent Text-to-Image Synthesis’, is accepted at WACV 2019.
Aug 6, 2018
MASON accepted at AutoNUE workshop, ECCV 2018, Germany.
Jul 24, 2018
Interned at Harada-Ushiku lab, University of Tokyo, Japan.
Jun 29, 2018
Our paper accepted at ‘Towards learning with limited labels’ workshop, ICML 2018, Sweden.
Publications
4 x CVPR, 3 x ICCV, 3 x ECCV, 3 x WACV, 1 x {TPAMI, NeurIPS, AAAI, IJCAI, BMVC, IROS}

2025
Teleportraits: Training-Free People Insertion into Any Scene
ICCV 2025
Jialu Gao, K J Joseph, Fernando De la Torre
Forget with Care: A Domain-Agnostic Framework for Concept Erasure without Side-effects.
ICCV-W 2025
Aakash Kumar Singh, K J Joseph, Srikrishna Karanam, Venkatesh Babu Radhakrishnan
Design-o-meter: Towards Evaluating and Refining Graphic Designs
WACV 2025
Sahil Goyal, Abhinav Mahajan, Swasti Mishra, Prateksha Udhayanan, Tripti Shukla, K J Joseph, Balaji Vasan Srinivasan

2024
POET: Prompt Offset Tuning for Continual Human Action Adaptation
ECCV 2024 (Oral)
Prachi Garg, K J Joseph, Vineeth N Balasubramanian, Necati Cihan, Chengde Wan, Kenrick Kin, Weiguang Si, Shugao Ma, Fernando De la Torre
MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models
CVPR 2024 (Highlight)
Sanjoy Chowdhury, Sayan Nag, K J Joseph, Balaji Vasan Srinivasan, Dinesh Manocha
Contextual Prompt Learning for Vision-Language Understanding
AAAI 2024 (Oral)
Koustava Goswami, Srikrishna Karanam, Prateksha Udhayanan, K J Joseph, Balaji Vasan Srinivasan
Iterative Multi-granular Image Editing using Diffusion Models
WACV 2024
K J Joseph, Prateksha Udhayanan, Tripti Shukla, Aishwarya Agarwal, Srikrishna Karanam, Koustava Goswami, Balaji Vasan Srinivasan

2023
A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis
ICCV 2023
Aishwarya Agarwal, Srikrishna Karanam, K J Joseph, Apoorv Saxena, Koustava Goswami, Balaji Vasan Srinivasan
Data-Free Class-Incremental Hand Gesture Recognition
ICCV 2023
Shubhra Aich, Jesus Ruiz-Santaquiteria, Prachi Garg, Zhenyu Lu, K J Joseph, Alvaro Fernandez Garcia, Kenrick Kin, Chengde Wan, Vineeth N Balasubramanian, Necati Cihan Camgoz, Shugao Ma, Fernando de la Torre
D3Former: Debiased Dual Distilled Transformer for Incremental Learning
CVPR-W 2023
Abdelrahman Mohamed, Rushali Grandhe, K J Joseph, Salman Khan, Fahad Shahbaz Khan

2022
Novel Class Discovery without Forgetting
ECCV 2022
K J Joseph, Sujoy Paul, Gaurav Aggarwal, Soma Biswas, Piyush Rai, Kai Han, Vineeth N Balasubramanian
Class-Incremental Learning with Cross-Space Clustering and Controlled Transfer
ECCV 2022
Arjun Ashok, K J Joseph, Vineeth N Balasubramanian
Energy-based Latent Aligner for Incremental Learning
CVPR 2022
K J Joseph, Salman Khan, Fahad Shahbaz Khan, Rao Anwer, Vineeth N Balasubramanian
OW-DETR: Open-world Detection Transformer
CVPR 2022
Akshita Gupta, Sanath Narayan, K J Joseph, Salman Khan, Fahad Shahbaz Khan, Mubarak Shah
Spacing Loss for Discovering Novel Categories
CVPR-W 2022 (Best Paper Runner-Up)
K J Joseph, Sujoy Paul, Gaurav Aggarwal, Soma Biswas, Piyush Rai, Kai Han, Vineeth N Balasubramanian
New Vehicles on the Road? No Problem - We’ll Learn Them Too
IROS 2022
Deepak Kumar Singh, Shyam Nandan Rai, K J Joseph, Rohit Saluja, Vineeth N Balasubramanian, Chetan Arora, Anbumani Subramanian, C.V. Jawahar

2021
Incremental Object Detection via Meta-Learning
TPAMI 2021
K J Joseph, Jathushan Rajasegaran, Salman Khan, Fahad Shahbaz Khan, Vineeth N Balasubramanian
Towards Open World Object Detection
CVPR 2021 (Oral)
K J Joseph, Salman Khan, Fahad Shahbaz Khan, Vineeth N Balasubramanian
ORDER: Open World Object Detection on Road Scenes
NeurIPS-W 2021
Deepak Kumar Singh, Shyam Nandan Rai, K J Joseph, Rohit Saluja, Vineeth N Balasubramanian, Chetan Arora, Anbumani Subramanian, C.V. Jawahar

2020
Meta-Consolidation for Continual Learning
NeurIPS 2020
K J Joseph, Vineeth N Balasubramanian
Zero-shot Domain Generalization
BMVC 2020
Udit Maniyar, K J Joseph, Aniket Deshmukh, Urun Dogan, Vineeth N Balasubramanian

2019
Submodular Batch Selection for Training Deep Neural Networks
IJCAI 2019
K J Joseph, Vamshi Teja Racha, Krishnakanth Singh, Vineeth N Balasubramanian
C4Synth: Cross-Caption Cycle-Consistent Text-to-Image Synthesis
WACV 2019
K J Joseph, Arghya Pal, Sailaja Rajanala, Vineeth N Balasubramanian

2018
MASON: A Model AgnoStic ObjectNess Framework
ECCV-W 2018
K J Joseph, Rajiv Chunilal Patel, Vineeth N Balasubramanian
VisDrone-DET2018: The Vision Meets Drone Object Detection in Image Challenge Results
ECCV-W 2018
Zhu Pengfei, Wen Longyin, Du Dawei, others
Zero-Shot Image Generation by Distilling Concepts from Multiple Captions
ICML-W 2018
K J Joseph, Arghya Pal, Sailaja Rajanala, Vineeth N Balasubramanian

Also on Google Scholar.
Talks and Lectures
June 29, 2025
Helped to coach students on Computer Vision for International Olympiad in Artificial Intelligence (IOAI) 2025. Glad that the students did great!
Dec 13, 2024
Delivered a tutorial on Multi-modal Generative Models at ICVGIP 2024.
Dec 7, 2024
Delivered a tutorial on Generative Models at Winter School on Generative AI, organized by IIT Jodhpur.
Jul 3, 2024
Delivered a tutorial on Generative Models at Summer School on AI, organized by IIIT H.
Nov 25, 2023
Delivered a tutorial on “Augmenting Human Creativity with Computer Vision” at HAAI, IIT Kharagpur.
Jul 13, 2023
Delivered a tutorial on Continual Learning at Summer School on AI, organized by IIIT H.
Dec 12, 2022
Invited talk at Continual Lifelong Learning Workshop co-located with ACML 2022.
Jun 14, 2022
Invited talk at Rakuten Research.
Dec 22, 2021
Vision India at ICVGIP 2021.
Sep 1, 2021
TCS Reseach ReCafe.
May 14, 2021
Invited talk on open-world learning at RAM-LAB, HKUST.
Collaborators
PhD Interns at Adobe Research: Undergraduate Interns at Adobe Research: Research Collaborators: I have had the chance to work with great minds at MBZUAI, Google Research, CMU, IISc, IIT K and University of Hong Kong among many others.
Services
“And, when you want something, all the universe conspires in helping you to achieve it.” ― Paulo Coelho, The Alchemist.